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Abstract 

We explore the relation between the von Neumann entropy and the 
Renyi entropies of integer orders for shift-invariant quasi-free Fermionic 
lattice systems. We investigate approximating the von Neumann en- 
tropy by a combination of integer-order Renyi entropies and give an 
estimate for the quality of such an approximation. 
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1 Introduction 



The motivation for this paper is to better understand the relation between 
the average von Neumann entropy and the average Renyi entropies of integer 
order. Entropies are non-local characteristics of a state and are, e.g., an es- 
sential input in the variational principle for thermal equilibrium. Restricting 
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the variational principle to specific classes of states leads to well-known ap- 
proximations like mean-field or Hartree-Fock [9] . More refined approximation 
schemes like matrix product states for computing ground states of quantum 
spin chains turned out to be quite effective [7, 11]. Extensions to higher di- 
mensional quantum spin lattices are currently investigated [4] and one might 
wonder about using general finitely correlated states for thermal states. Com- 
puting the mean von Neumann entropy for a general, shift-invariant, finitely 
correlated state is, however, still an open problem [5]. 

In [13], Renyi introduced a generalised entropy of order a defined as 

S» := --L- Trp", (1) 

where p is a density matrix, a ^ 1, and a > 0. The von Neumann entropy 
is obtained as the limit 

S p = lim SJa) = -Trplogp. (2) 

a— >1 

Renyi entropies of integer order «6 {2,3,...} can often be easily computed 
using several copies of the system, by way of the so-called replica trick: 

Trp" = Ti p® p®---® p T n (3) 

n times 

where T n is the cyclic shift on the n-fold tensor power of the original system. 
For an example of this replica trick applied to a spin glass, see [2]. The 
question is then how to reconstruct the von Neumann entropy given the 
Renyi entropies of integer order 2,3,... 

In fact, the relevant quantity for shift-invariant states is the average Renyi 
entropy. Unfortunately, these densities pose several serious problems with 
regard to existence and continuity. In general, they simply don't exist and 
they are also not affine on convex subsets of shift-invariant states. Their 
use is therefore limited to states with strong clustering. Moreover, it is 
completely unclear whether the knowledge of integer-order average Renyi 
entropies uniquely determines the average von Neumann entropy. 

A number of papers have considered relations between the integer-order 
Renyi and von Neumann entropies [8, 6, 15]. These relations don't always 
scale properly with the system size and therefore don't necessarily survive 
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on the level of densities. There is certainly no general procedure, even un- 
der strong assumptions on clustering, for passing from integer-order Renyi 
to von Neumann entropies. Further suggested reading on the subject can be 
found in [1, 10, 12]. 

In this paper we consider the case of shift-invariant quasi-free Fermionic 
states on a lattice. We show that such a reconstruction procedure exists in 
this case and obtain some simple approximations in terms of the first few 
Renyi densities. 

The paper is organised as follows: in Section 2, we remind the reader of the 
description of Fermions on a lattice and introduce the notation. Section 3 
gives the expression for the average Renyi entropies of quasi-free states. In 
Section 4, we introduce a completely monotonic entropy function which is 
then used in Section 5 to reconstruct the von Neumann entropy. Finally, we 
provide an explicit approximation scheme in Section 6 

2 Fermions on a lattice 

We consider a system of Fermions living on some Bravais lattice C in H d : 

C = {ni£i + n 2 e 2 H h n d e d | ni, n 2 , . . . , n d e = {n • e | n e (4) 

where {ej} are the primitive vectors of the lattice. For our purposes, we can 
identify n ■ e with n. 

Fermions on the lattice are described by smeared out creation and annihi- 
lation operators c' and c obeying the canonical anticommutation relations. 
The smearing is by square summable sequences on the lattice: 

f(Z d ) c f (y9) is C-linear (5) 

and the anticommutation relations are 

{c(v9),c(^)} = and {c(<p),Jty)} = {<p,if>)l. (6) 

The creation and annihilation operators generate the C*-algebra A(1i d ) of 
canonical anticommutation relations (CAR) on 1i d . 

Lattice translations induce ^-automorphisms on A(1i d ) by extending 

c(<p)^c(U(n)<p). (7) 
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Here U(n) is the unitary shift on £ 2 (Z d ) by n G 1 d 

(f/(n)^)(k) = ^(k-n). (8) 

We also need quasi-free states ojq, sometimes called Gaussian Fermionic 
states. They are uniquely determined by their two-point correlation func- 
tions 

(<p,il>)^u(c\<p)c(il>)), y^G£ 2 (Z d ). (9) 

All expectations of monomials in creation and annihilation operators vanish 
except for 

w(ct(^ 1 )... c t(^ n ) c (^ n )... c (^ 1 )) =deb([u(J(<p k )c(ip t ))] ke )- (10) 
Due to the complex linearity of c*, and the conjugate linearity of c, 

{vrf)*u(c\(p)cW)) (11) 

is a sesquilinear form on £ 2 (Z d ). One can show that the necessary and suffi- 
cient condition for (10) to define a state is that the form (11) corresponds to 
a linear operator Q on l 2 {7L d ) such that < Q < 1: 

u(c\<p)c(?l>)) = (1>,Q<p). (12) 

The operator Q, called the symbol, defines the state uq, where the notation 
stresses the dependence of the state u on Q. 

A quasi-free state ojq is shift-invariant if and only if Q commutes with the 
lattice-shift unitaries U(n) defined in (8). In the standard basis {ej} of (?(JL d ) 
this is equivalent with 

(ej,Qe k ) = (e j+n ,<2e k+n ), j,k,ne^. (13) 

If F denotes the unitary Fourier transformation 

(F^)(x):=^ V (n)e 2 ™- x , x G [0, if (14) 

this is equivalent to 

FQ = qF (15) 
where q is the multiplication operator with the function 

g(x) = ^( e o,g ej )e 2 ^ x (16) 

on £ 2 ([0, l} d ). As < Q < 1, q takes values in [0, 1]. For more details on 
these matters we refer to [3]. 
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3 Renyi entropies 



Let A be a finite subset of Tfi. The local algebra A(A) is generated by the 
creation and annihilation operators with smearing functions supported in A. 
This algebra is isomorphic to the algebra of matrices of dimension 2*^ and 
has therefore, up to unitary equivalence, a unique irreducible representation. 
This allows one to assign to any state u on A(A) the Renyi entropies 

S w (a) := l — logTrp", a > 0. (17) 

a — 1 

Here p is the density matrix defining u in an irreducible representation of 
A(A). For a — 1, the expression in (17) has to be replaced by its limit, the 
von Neumann entropy 

S w :=S w (l) = -Tr(plogp). (18) 



The local Renyi entropies of quasi-free states can be readily expressed in 
terms of the local restrictions of their corresponding symbols Q. Moreover, 
one can show that for shift-invariant quasi-free states the limiting average 
Renyi entropies in the sense of growing boxes exist and one obtains an explicit 
expression in terms of the Fourier transform q: 



s q {a) 



^— [ dx]og(<f + (l-q) a ). (19) 
« - 1 J[0,l] d 



In the case of the von Neumann entropy density, this expression must again 
be understood as 

s, = - / [q log q + (1 - q) log(l - q)} . (20) 



4 A completely monotonic entropy 

It is known that for a general density matrix p in a matrix algebra 

«G]0,ooh ^logTrp a (21) 

a — 1 
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is a monotonically decreasing function, in particular 



S P >S P (2)>S P (3)>--- (22) 

This ordering then extends to densities, provided they exist. This is certainly 
the case for shift-invariant quasi-free states, where it is not hard to compute 
the asymptotic value 

Sg(oo) = lim s q (a) = — rfx logTmaxlg, (1 — q)}]. (23) 



We now introduce a modified entropy-like function: 

g q (a):=s q (oo)-^s q (a), a > 0. (24) 

To avoid technical complications, we assume from now on that q = or q = 1 
on a set of measure zero. This is, e.g., true for thermal states of quadratic 
interactions at non-zero temperature. The general case can be handled by 
removing the union of the kernels of q and 1 — q from [0, l] d . One now easily 
verifies that 

g q (a) — — I <ix log[l + exp(— ah)], (25) 
" ./ ii.i ' 

where we have introduced the function 

h: [0, l] d ^ R+ :/*:=- log (minj^— (26) 

A function / :]0, oof— > R is called completely monotonic if its derivatives to 
all orders exist and if 

(-l) n / (n) > 0, n = 0,1,2,... (27) 

Bernstein's theorem [14] characterises completely monotonic functions as the 
Laplace transforms of positive measures that don't grow too fast at infinity. 
We show here that, for a given q, 

a e]0,oo[^ g q (a) (28) 

is completely monotonic by computing its inverse Laplace transform. 
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Figure 1: The inverse Laplace transform of s i— )■ log(l + exp(— s))/s 



First, consider the function k on R + : 



(— 1 V +1 
k(t) = ~ : < t ^ °- 



3<t 



J 



(29) 



This function is piecewise constant, non-negative, continuous from the right, 
and tends to log 2, see Fig. 1. As k is of exponential order 0, we may compute 
its Laplace transform for all s G C with 3?(s) > by evaluating the integral 

C(k)(s)= I dtk(t)e~ st = J2J2 • ' dte ~ St 



1=1 3=1 



J 



1 S 3=1 3 



oo 



s _-^e^ = -log(l + exp(- S )). 

i=i 



(30) 



7 



This shows that 

s > i — >■ — log(l + exp(-s)) (31) 

s 

is completely monotonic. 

As complete monotonicity is preserved by rescaling the argument, rescaling 
the function, and addition, we conclude from (25) that 

a6]0,oo[H- g,(a) (32) 

is completely monotonic. We have, in fact, a rather explicit expression for 
the inverse Laplace transform of g q : 

C- 1 {g q )(t)=( dxk(l). (33) 



5 Reconstructing the von Neumann entropy 

In general, one cannot hope to uniquely reconstruct a function g that is ana- 
lytic in {z E C | $l(z) > 0} given the values of g on N . This is nevertheless 
often attempted in statistical mechanics of disordered systems where one tries 
to reconstruct the von Neumann entropy given the Renyi entropies of order 
2,3,... which can be computed using the replica trick. Suppose, however, 
that there exists a non-negative measurable function G of exponential order 
on R + such that 

poo 

g(a) = / dtG(t)e~ at , a>0 (34) 
Jo 

where g is related to the entropy densities s as in (24). We then have 

s (a,) = _^L_ / dt G(t) ( e-* - e~ at ), a^l (35) 
a - 1 Jo v ' 



and 



/■OO 

= s(l) = / dtG(t)te-*. (36) 
Jo 



Suppose that we know the integer-order entropies s(n) for n — 2, 3, . . . and 
that we wish to reconstruct the von Neumann entropy s given (35) and (36). 
The vector space generated by the functions 

/ n :tGRM^(e- i -e- ni ), n = 2,3,... (37) 
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is actually an algebra of continuous functions that vanish at and at oo. It 
is closed under complex conjugation and it separates the points in R + . We 
can therefore approximate 

tGR + ^te _i (38) 

uniformly to arbitrary precision by a linear combination of the f n using the 
Stone- Weierstrass theorem. 

Given a d- dimensional density matrix p and d — 1 Renyi entropies of integer 
order in {2, 3, . . .} we can uniquely reconstruct the ordered eigenvalues of p. 
This means that two density matrices with the same integer Renyi entropies 
are related by a unitary transformation. 

The mean Renyi entropies of a shift-invariant quasi-free state are of the form 
Jj ^ d dxf(q) where / is a bounded measurable function on [0, 1]. We can 
associate a distribution function to a symbol q in Fourier space as follows, 

7, ■■ V G [0, 1] H- j md dx. (39) 

</(x)<?/ 

We can then write 

I dxf(q)= fd lq (y)f(y). (40) 
J[o,i] d Jo 

Obviously, different symbols may yield the same distribution function and 
therefore the same mean Renyi entropies. Knowledge of the integer mean 
entropies with a G {2, 3, . . .} actually determines the distribution function 
except for contributions at or 1 which don't effectively contribute to any 
mean entropy for a > 0. 

Suppose that t is a Lebesgue measure preserving rearrangement of [0, l] d , i.e. 
a transformation of [0, l] d such that 

f dx= f dx (41) 
JxeA Jt(x.)eA 

for every measurable set A. The mapping 

U t : Lp i-> ip o t (42) 
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is a unitary transformation of £ 2 ([0, l] d ) such that for a multiplication oper- 
ator by q 

U t q=(qot) U t . (43) 

The Fourier transformed symbols q and got define different shift-invariant 
quasi-free states on A(Ti d ) which are related by the automorphism defined 
through U t . 

The distribution functions (39) of these states coincide and therefore have 
the same mean entropies. This situation can be seen as a partial quasi-free 
analogue of the density matrix case discussed above. There are, however, 
plenty of symbols that yield the same mean entropies and that are not related 
by a rearrangement. 



6 Explicit approximations 

Let us extend the notation in (37) by defining 

h(t)=te- t . (44) 

A simple-minded n-term approximation of fi consists in finding the minimis- 
ers of 

(7l, . . . , 7 n ) H> ||/i - 71 / 2 7„ /n+l||oo (45) 

by demanding that all extrema of the above function are equal in magnitude. 
The first few optimal approximations are 

HA- 0.800/21)00 = 0.09 

||/i - 2.219 / 2 + 1.314 /alloc = 0.04 

HA - 4.233 / 2 + 6.133 / 3 - 2.850 / 4 ||oc = 0.02 

H/i - 6.833 f 2 + 17.498 / 3 - 18.780 / 4 + 7.148 / 5 |U = 0.01. 

In comparison, ||/i||oo ~ 0.368. 

This corresponds to the approximations of the mean von Neumann entropy 
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Figure 2: Difference between te 1 and its 1, 2, 3 and 4-term approximations 
as indicated, given by Equation (45) 

by the first few mean Renyi entropies 



The single term approximation is certainly terrible because we know from 
the monotonicity of the Renyi densities that 



The multi-term approximations are, however, no longer direct consequences 
of the monotonicity of the Renyi densities. The quality of (47) is not easily 
established because the measure G(t)dt is generally unbounded. 

Under our assumption on q, the function G in (35) tends to log 2 at infinity. 
As the supremum norm is attained close to the origin, we cannot expect to 



s q « 0.800 Sq(2) 
w 2.219s g (2) 
« 4.233 s,(2) 
« 6.833 s,(2) 



1.314 s,(3) 

6.133 s,(3) + 2.850 s,(4) 

17.498 s,(3) + 18.780 s,(4) - 7.148 s,(5) 



(47) 



Sq > S g (2). 



(48) 
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obtain a very good approximation this way. A better approach, especially 
at high temperatures, is to subtract the asymptotic value log 2 from G and 
then use (46). This yields 

s q « 0.200 log2 + 0.800s 9 (2) 

« 0.095 log 2 + 2.192 s,(2) - 1.314 s,(3) 

« 0.050 log 2 + 4.233 s,(2) - 6.133 s ? (3) + 2.850 s,(4) 

« 0.033 log 2 + 6.833 s,(2) - 17.498 s,(3) + 18.785 s ? (4) - 7.148 s,(5) 

(49) 

One can, however, still not hope that G — log 2 is integrable. 

A controllable approximation scheme can be set up by using Renyi densities 
of order less than one and using the uniform bound 



s g( a ) 



a 



a 



- J dtG{t) (e~' - e~ at ^ < log 2. 



(50) 



Extending the definition of f n in (37) to general a G R + we write 
s q -7i s ? (2) 7„s 9 (n + 1) 

J°°dtG(t) (^(O - 7l / 2 (0 7»/n+l(*)) 

„ ^ G(t)/a(t H^-^7^)"'''~ 7 "W. 



< 



/l h _ fn+l 

e Tl /■ ' ' ' In r 

J a. J a. J a 



log 2. 



(51) 



It now remains to minimise the bound (51) for a given n with respect to 
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71, • • • , 7n and a e]0, 1[. This leads to 

|s 9 - 0.666 s g (2)| < 0.35 

js, - 1.938 s g (2) + 1.005 s,(3) | < 0.19 

|s, - 3.892 s g (2) +4.967 s,(3) - 2.048 s 9 (4)| < 0.12 

|s 9 - 6.556 s g (2) + 15.064 s g (3) - 14.413 s,(4) + 4.923 s,(5) | < 0.08 

|s, - 37.181 s 9 (2) + 529.415 s g (3) - 3 846.261 s g (4) + 16 301.725 s 9 (5) 

- 43 168.833 s 9 (6) + 73 647.855 s,(7) - 80 999.681 s,(8) + 55 517.489 s 9 (9) 

- 21 580.373 s 9 (10) + 3 634.848 s,(ll) | < 0.03 

(52) 




Figure 3: Difference between fx/ f a and its controlled 1, 2, 3 and 4-term 
approximations re-scaled by f a , given by Equations (51) 

The corresponding values for a are: 0.661, 0.515, 0.435, 0.384, and 0.261 
respectively. 
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7 Conclusion 



In this paper, we consider the reconstruction of the average von Neumann 
entropy in terms of average Renyi entropies of integer order, which, for some 
classes of states, are computed rather easily. Obtaining general estimates 
and relations for these quantities is a long-standing problem. 

We have restricted our attention to shift- invariant quasi-free Fermionic states 
on a regular lattice and obtain two results. Firstly, we proved that the mean 
von Neumann entropy is reconstructible in terms of mean Renyi entropies 
of integer order. Next, we set up an explicit approximation scheme. This 
scheme, including the controlled approximations (52), relies only on the valid- 
ity of the representation (35) and is therefore applicable to general systems 
for which (35) holds and is not only limited to the shift-invariant quasi- 
free states considered here. Of course, the log 2 asymptotic limit given in 
the controlled approximation scheme should be adjusted according to the 
dimensionality of the states in question. It should be noted that the coeffi- 
cients in (46) and (52) are not easily expressible in a general analytical form. 
Moreover, the obtained approximations are generally neither upper nor lower 
bounds. 
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